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IDENTIFIERS 
ABSTRACT 

Five computerized narrative assessment reports are 
discussed* These are: (1) the Teaching Information Processing System 
Student Report, used for a college economics course; (2) the 
Preliminary Scholastic Aptitude Test (PSAT) Score Report; (3) the 
Programmed Composition of Psychological Test Reports employed at the 
Mayo clinic for reporting results of the Minnesota Multi-phasic 
Personality Inventory and the California Psychological Inventory; (H) 
a report devised by the Madison, Wisconsin public schools to explain 
individual performance on the Iowa Tests of Basic Skills; and (5) a 
report developed under the auspices of the Iowa Testing Programs to 
serve as a model narrative system for communicating results of the 
Iowa Tests of Basic Skills, The conclusion is reached that such 
narrative reports have several advantages, including flexibility, 
efficiency, and clarity of communication* In addition, since they 
provide personalized and self-explanatory information to students, 
parents, and other laymen, they serve an important public relations 
function. (PB) 
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When a person takes a test (or in some way is formally assessed), 
a report is usually produced. The report may be simply the number of 
correct items on the test, or it may be a detailed description of the 
testee's responses to a psychological test battery with comments and 
interpretation from a psychologist. The purpose of assessment reports 
is communication of information for decision-making, and the communication 
must be understandable to the receiver of the report. 

Assuming no difficulties with the validity and reliability of the 
test, and a general understanding of the purpose and method of the test, 
the major barrier to understanding a performance report is understanding 
the language that is used. The language is usually numerical values 
of quantitative concepts such as raw scores, grade-equivalent scores, 
stanines, percentiles and standard errors of measurement. Certainly 
the target audience of the reports (students or parents or instructors 
or counselors, etc.) determines the kind of concern that language 
problems elicit; but to err by assuming an undistorted transmission 
of information is easy and a common occurrence, ^ 

The result of an understandable report should be the transfer of 
information on performance that can be used in the decision-making 
process. In the case of standardized achievement tests in education, 
Goslin found (3, p. 32) that elementary teachers receive score reports 
on pupil performance about 80 percent of the time and have free access 
to these scores in virtually every case, yet this information is shared 
routinely with pupils and their parents less than eight percent of the 
time. Current test reporting practices, then, seem to indicate that at 
least some of the information that could be useful in making educational 
decisions about a child is not routinely shared with the child and his 
parents. Proceeding on the assumption that testing information should be 
shared with parents and children, the obvious prohibiting factor is that 
"they would not understand the report." That is probably true. After 
all, some of our teachers and administrators have difficulty understanding 
current test reports. An alternative to depriving parents and students 
of testing information is to produce a testinq report that is understand- 
able to them . The suggestion and theme of this paper is the use of 
reports that are in a narrative format words that blend to form 
sentences which join into paragraphs. 



OR, WALTER M. MATHEWS is assistant professor of educational administration 
at the University of Mississippi , teaching courses in computer applications > 
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Let's look at a few early attempts to utilize the computer in 
generating narrative reports. 

Teaching Information Processing System (TIPS) 

Kelley (5), a professor of economics at the University of Wisconsin, 
developed a program* which he called TIPS, to assist him in teaching. 
TIPS involved periodic collection of information from students regarding 
either their understanding of course materials or their reaction to various 
aspects of course presentations. TIPS provided a means of efficiently 
utilizing this information for instructional purposes. The information, 
which is collected on specialized forms suitable for machine processing, 
is composed of student responses to a series of multiple-choice questions. 
Surveys of six to twelve questions took about five to ten minutes to 
administer. Within a few hours this information was processed and 
summarized in three '>eparate reports: one for each student, one for each 
section leader, and a third for the professor. 

The student report contained a summary of his performance: his 
response to each question, the correct answers, and the total number of 
his correct answers. On the basis of this information, assignments for 
the forthcoming period were also indicated. The assignments (some required 

some optional) varied considerably in nature, level, and intensity. 
A student scoring well might have received optional assignments and/or 
required work at a higher level. The student performing poorly might have 
received not only the required work, but also a set of materials designed 
to bring him toward the mean class performance. 

Additional information on the student report was generated on the 
basis of past as well as current performance. If the student had performed 
poorly over several surveys, he was instructed on the student report to 
establish an appointment with the instructor or teaching assistant. If the 
student performed consistently and exceptionally well , he might have been 
notified that a short paper could be substituted at his option 
for the midterm examination. A sample of a TIPS student report is 
presented as Figure 1. 

The teaching assistant report contained information to help him 
appraise the performance of his individual sections, including statistics 
on percentage correct by question or by concept, actual responses on the 
survey, lists of students required to establish appointments or tutorials, 
and so forth. 

The professor's report was similar to that received by the teaching 
assistant, although the information available applied to all students 
enrolled in the course rather than only to the students in particular 
sections. With this information the professor might elect to alter lectures, 
section coverage, problem sets, or other teaching instruments for the 
forthcoming period. In summary, TIPS is a system for gathering and 
reporting objective and timely Information useful for more effective 
teaching. 



SAMPLE COPY OF KELLEY'S TEACHING INFORMATION 
PROCESSING SYSTEM (TIPS) STUDENT REPORT 

TIPS 

STUDENT PERFORMANCE SUR\€Y, RESULTS 
PRINCIPLES OF ECONOMICS (105) 
PROFESSOR ALLEN C, KELLEY 

yM' 

SURVEY TAKEN ]D/25/^7 ^ ^ 
SEaiON NIMBER AND TIME 2/ 9:55 F 
SECTION LEADER MISS GREEN 

cor OF A TOTAL OF ID QUESTIONS/ YOU CORRECTLY ANSWERED 3. THE QUESTION 
Nt>BER. YOUR RESPONSE AND THE CORRECT ANSWER ARE PROVIDED IN THE TABLE 
BELCW. YOU ARE U(?GED TO WKE SURE YOU UNDERSTAND THE NATURE OF ANY 
INCORRECT RESPONSES YOU MAY HAVE MACE. 
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YOUR ASSIGNMENT TOR THE WEEK. TO BE HANDED IN DURING THE DISCUSSION 
SECTION ON lJ/03/6/, IS THE FOLlJf^nNG — 

PRQBLHMS L 3 AND ^ ON HANDOUT 2C 

ADDITIONALLY/ YOU ARE REQUIRED TO WORK THR0U3H CHAPTER 2 OF - MICRO- 
ECONOMICS/ A PROGRAMMED BOOK, BY LLMSDEN/ AHIYEH/ AND BACH, IT WOULD 
BE USEFUL TO CONSULT THE PROGRAMMED UNIT BEFORE YOU READ HANDOUT 2t. 

TO TEST YOUR UNDERSTANDING OF THE MATERIALS/ YOU MAY/ AT YOUR OPTION/ 
ELEa TO COMPLETE THE FOLLOWING PRCBLEMS ~ 

1. WORKBOOK/. PP, 37-38, 

2. HANDOUT 2A/ PROBUMS 3 AND ^, 

NOTICE — AN ALL UNIVCRSITY LHCTURE BY PROFESSOR MILTON FRIECMAN/ PAST 
PRESIDENT OF THE_^RICAN ECONOMIC ASSOC! AT I ON/ WILL BE HELD IN b210 
SOCIAL SCIENCE/ /: 33 p.m. , 11/01/67. IHE TOPIC — MDNETARfi' AND FISCAL 
POLICY RECONSIDERED, 



Preliminary Scholastic Aptitude Test (PSAT) Score Reports 

The effective reporting of test results to admissions officers^ guidance 
counselors, and the individuals who take educational tests is a rather more 
complex matter than might appear at first glance. It is apparent that 
reporting only numerical scores is hardly adequate. The statistical, 
psychological, and educational contexts which allow the user to infer 
relevant meanings must be provided as well. The problem is particularly 
acute for the programs in which the primary reporting target is the test 
taker himself. 

Since the precise interpretation of mental test scores does require 
a knowledge of statistics, measurement, psychology, and education, it is 
common practice to have test scores reported to individual test takers 
by guidance counselors who are expected to have the necessary sophistication. 
Unfortunately, not all guidance counselors do have sufficient psychojnetric 
sophistication, nor do they have the time to prepare detailed analyses and 
to give individual interpretation of mental tests results. Of course, 
most educational testing services prepare a wide range of interpretive 
materials for their testing programs to aid both the counselor and the 
student in interpreting test scores. But even with these aids, some 
statistical sophistication is still needed for adequate understanding. 

Helm and Harasymiw (4) designed variable format computer-generated 
letters to be sent to examinees of the Preliminary Scholastic Aptitude 
Test as a report of their performance on the test. They found it necessary 
to prepare eighty distinct sentences where a sentence might have 
variable phrases imbedded. These eighty sentences were used to compose 
seventy-five distinct paraaraphs which, in turn, were combined to produce 
the 100 letters needed to interpret all combinations of verbal and mathe- 
matical scores. They wrote a computer program to generate these letters 
and a sample of their report appears as Figure 2. 

Programmed Composition of Psychological Test Reports 

A computer-generated verbal diagnostic report on a standardized 
psychological test has been used routinely at the Mayo Clinic in Rochester, 
Minnesota since 1962 (7) and is available cofmercially from Behaviordyne, 
Inc. The Mayo program utilizes the Minnesota Multi -phasic Personality 
Inventory (MMPI) which is an objective pencil-paper psychological t^st. 
The machine-produced report is a group of disconnected statements » or 
decisions, about the subject as measured by the scales of the MMPI. 
Finney improved the Mayo program by offering an alternative of adding 
scales from the California Psychological Inventory (CPI) , and by improving 
the coherence of the report (2). A large number of scales are scored, 
101 with the MMPI alone or 124 with the MMPI and the CPI. 

The report is built by selecting statements and then combining them 
into paragraphs* For each of the 101 scales, one statement is chosen 
from among eight possible statements, depending on the individuaTs score 
on the scale. By this method, 101 statements are chosen from a repertory 
of 808. Finney's program has the computer compose a full report on each 
individual's personality the kind of report that a psychologist might 
write after seeing a person several times and administering a full battery 
of tests. The first one-third of a sample report is given as Figure 3. 



nr<i^ cm AVAiLA^iLE SAHP1£ copy of TIIF: PRELIMINARY SCHOLASTIC ' 

^ APTlllIUE TEST (PSAT) SCORE REPORT 

EDUCATIONAL TESTING SERVICE 
PRINCETON, N,J. 085^^0 

JANUARY 2L 1966 

tEAR NR, L£TR 99, 



WE WANT TO REPORT TO YOU THE SCORES YOU EARMED ON TH{ 
.1 MI NARY SCHOLASTIC APTITUDE TEST YOU TOOK ON OaOBER 



■LI MI NARY SCHOLASTIC APTITUDE TEST YOU TOOK ON OaOBER 9, 
ib. YOUR APTITUCe f=OR COLLEGE WORK IS OUTSTANDING. IF YOUR 
HIGH SCHOOL MARKS ARE CONSISTENT WITH THE HIGH SCORES YOU HAV€ 
EARNED ON THE TEST YOU WILL HAVE LITTLE DIFFICULTY IN BEING 
ACCEPTED AT A COLLEGE OF YOUR CHOICE. 

YOU EARNED A SCORE OF 68 ON THE V€FBAL SEaiON OF THE TEST. 
THE VERBAL SECTION OF T\\E TEST I^ASURES YOUR ABILITY TO READ 
WITH UNDERSTANDING AND TO USE WORDS EFFECTIVELY. A SCORE AS HIGH 
OR HIGHER "IHAN THE ONE YOU HAV€ EARNED IS EARNED BY LESS THAN 11 
PER CENT OF JLNIORS OF YOIR SEX WHO UTER ENTER COLLEGE. VERBAL 
APTITlXe IS PARTICULARLY irPORTANT FOR SUCCESSFUL COLLEGE WORK 
IN THE Hll^WNITIES AND FINE ARTS. 

YOU EARNED A SCORE OF 68 ON THE MATHEMATICAL SECTION OF THE 
TEST. THE MATHEMATICAL SECTION OF THE TEST MEASURES YOUR ABILITY 
TO REASON AND WORK EFFECTIVELY WITH NlhBERS. A SCORE AS HIGH OR 
HIGHER THAN THE ONE YOU HAVE EARNED IS EARNED BY LESS THAN H 
PER CENT OF JUNIORS OF YOUR SEX WHO UTER ErfTER COLLEGE. 
MATHEMATICAL APTITUDE IS PARTICULARLY INPORTANT FOR SUCCESSFUL 
COLLEGE WORK IN THE SCIENCES AND ENGINEERING. 

YOU SHOULD NOT THIM< OF YOUR TEST AS EXACT POINTS BUT AS A 
RANGE OF SCORES EXTENDING ABOUT THREE POINTS ABOVC AND THREE 
POINTS BEUDW THE SCORE WE HAVE REPORTED TO YOU. THEY GIVE A GOOD 
INDICATION OF HOW YOU m EXPECT TO SCORE ON THE SCHOLASTIC 
APTITUDE TEST. THE CHMCES ARE POUR OUT OF FIV€ THAT YOU WILL 
SCORE BETWEEN 630 AND 730 ON THE VERBAL SECTION OF THE 
SCHOLASTIC APTITUCE TEST WHEN YOU TAKE IT NEXT YEAR. THE.XHANCES 
ARE POUR OUT OF FIVE THAT YOU WILL SCORE BETWEEN b30 AND 73U ON 
THE WTHEMATICAL SECTION OF THE SCHOLASTIC APTITUCE TEST WHEN 
YOU TAKE IT NEXT YEAR, INSOFAR AS VERBAL AN'D MATHEMATICAL 
APTITUDES ARE CONCERNED YOU CAN HAVE CONFIDENCE IN YOUR ABILITY 
TO DO SXCESSFUL COLLEGE WORK. 

THE SCORES YOU HAVE EARNED SHOULD ENCOURAGE YOU TO APPLY 
FOR ADMISSION TO AN OUTSTANDING COLLEGE. YOUR FUTURE EDUCATIONAL 
PLANS SHOULD CONSIDER ADVANCED GRADUATE WORK, AFTER YOU HAVE 
DISCUSSED YOUR SCORES WITH YOUR PARENTS AND YOUR COUNSELOR OR 
PRINCIPAL SHOULD YOU HAVE ADDITIONAL GlESTIONS ABOUT THEM YOU 
MAY WRITE TO EDUCATIONAL TESTING SERVICE* PRINCETON/ N. J. 

SINCERELY YOURS, 

Hliliiiili T. s, :-mwm:Smi^ 
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Figure 3 

SAJ!PI£ COEY OF FINNEY'S REPORr ON im MtNNESOTA 
.MJLTI-PHASIC PEfiSONALlry INVENTORY 

anJIt 11^"^^.°^ ""^r ''^'"^ °' ' '^"^^'^ "^■^'>«^ B000005. This test like 

«vt*«b subject to error. Testingon/y supplements other diagnostic exam/nat/ons 

Jw? '^^ ""'"'^ ^^''c'l took the test 

. ,Sn li^tTl^"' '"^ conventional an^vers. That may be 

/V .i^u^ "V"** '""'^3' judgment, and of beino sufflclemlv stLdv 

LJ rel able and realistic. She does not give a consistently favorable' T a 2nsi«e^,y 

<^ ur,favorab!. picture of hersejf. She Is afraid to admit even small flaws in her^ f In 

H*-J terms of standards which are naive, rigid, perfectionistic. moralistic ^n eaSc a,^ 

L «r '^f obligations, which people can and will expect her to me«. 

Z I JT ^^"^^^^-^^''^^^ 'n Which a falling short in performance is toterabre 

^r?., 5.! ""^^ "^"^"^ 01 warmth. She is moderately ambittous, alert, and 
productive, a.>d likes working. She has no serious doubts about herself ^'e^. 

She does not teit of anxiety or stress and is not fooking for help. She is a reasonatofv 
oampl.ant person. She has a normai amount of flexibility. " « reasonaofy 



A S. 7-*' 
lt-4, Jtbw^S* 
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2pe-3! 
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27^ 

Em-7, 4-S* 

Dom-4,£tS 

6-3 

PtK-4* 

42 3, 
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Rf^S*,3-4* 
Ot.i*,0dy.4' 



In terms of these factors, she seems to be a normal, average, flexible persoi.. 

of tml '^^r'^'r' ^""^ "^"^^"'on reactions 

hL^ ^ f exhibitionlslic. self-centered ari 

demanding and lends to manipulate and exploit people. Because of r;pression he t;i» 
<r«lflhl and is not motivated for psychotherapy. * 
How. what is (he evWence for psychosis or mental ilJness? 

a* ?H T"^- P^^''''^- S<""e -"ensures are doubtful, 

as follows The obsessive and schisophrenic indicators are about at equal level On a 

w^rd of' ;X P^^-'^^"-- She does not u.e ricuais or compulsive acts at a« to 

Next we consWer narcissism, guilt, and basic trust, 

Her self-esteem is low arxl site doesn't feel proud of herself. But by another measure 
her self-acceptance is within the average range, though she tends to S hiTifT 

Teast ave?.o/H ' ^^ ^'••"'^"i^^s^ess or embarrassment. She ha, at 

1m h^r . f"'"'"" '"^ ^^-^ "ores almost average on ego strigth 

C^"a! « r '"^T '"^"^ P^^^^'^^^^PV, bu, oni; if motiv^ion and 

d«re« are also present. To a moderate degree she maintains an optimistic attitude by 

t72l"T'Tr- °* ''"'^ less than the ave^^e per«n. 

She shows signs of having some fears or phobias. But she does not admit fear, or phobtei^ 

f^ow we turn our attention to problems of dependency ^".or pnooias. 

The signs are that she has only slightly more dependency ne^ than the tveraoe 

Now, what about beinq demandir>9 or orally ftas?r.\^ive? 



Finney and Auvenshire have subsequently developed several different 
kinds of reports written for different purposes. They are now extending 
their work to other objective psychological tests. 

Baker suggested (1) that electronic computer technology be utilized 
to generate reports on other types of testing instruments in order to make 
the results more meaningful to the persons examined and to facilitate 
better use of the results of testing. He concluded: 

The mechanics of having the computer program prepare verbal 
descriptions depends upon several factors. First, the insight 
of the test constructor into the area of interest; second, the 
relation of levels of test and diagnostic scores to pupil 
performance; third, the cleverness of the computer programmer 
in generating connecting prose from somewhat disconnected 
verbal descriptions. 

The Madison Project 

The purpose of the Madison Project (6) was to design, produce, 
an'^ evaluate computer-generated testing reports that would be useful to 
teachers and informative to parents, without requiring either parents or 
teachers to spend a lot of time preparing the reports or learning how to 
interpret them. In both cases, the reports were in a narrative format. A 
unique report was generated by a computer for each pupil, based on his 
scores on the fourth-grade level of the Iowa Tests of Basic Skills. 

Attempts were made: to increase the communicative role of the 
reports by putting them in a narrative format; to personalize the reports 
by lacing each report with the pupil's name and the appropriate personal 
pronouns; to make the reports more understandable by eliminating or 
deemphasizing certain interpretative concepts (viz. grade-equivalent scores 
and percentile ranks, and a basic form for the explanatory paragraphs 
was developed, and then several parallel forms of each paragraph were 
written to provide variety of style. The first five paragraphs of each 
report described the pupil's performance on the text battery as a whole 
and on each of the sub-tests. Next, lists of specific areas were printed 
for which the pupil was diagnosed as either proficient or deficient — 
areas, in which he was neither, were suppressed. These decisions were 
based on item analyses performed by the teachers in the Madison (Wisconsin) 
Public Schools and criterion levels set by them. 

Figure 4 is a sample of a report to parents. The teacher report was 
very similar to this report, with the addition of imbedded percentile 
ranks. The parent reports were distributed at a parent-teacher conference 
and were the basis for a discussion of the child's performance. 

One other report was generated a class-summary report for the 
teacher. This reporc was similar in format to the report on an individual 
student, but i t discussed the class as a whole and concluded with specific 
suggestions that might be useful to the teacher in impt'oving class performance 
in the tested areas in which their performance was weakest. 
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fAflENT REPORT ON iNOIVIOUAL PERFORMANCE ON THE IOWA TESTS OF BASIC SKILLS 

AOMINlSTEnEOSEPTEWBER 1970 
MAO<SON PUOLIC SCHOOLS 
MADISON, WISCONSIN 

STUOENTl DANIEL MARSHALL 
TEACHER: MRS.ANASTASI 

ACCORDING TO THIS TEST. DANIE LS OVERALL ACHIEVEMENT LEVEL IS AT THE 75 PERCENTILE 
WHEN COMPAREO WITH STUDENTS IN GRAOe A IN THE MADISON SCHOOLSYSTEM, AND AT THE 79 
PCnCENTILE WHEN COMPARED WITH A NATIONAL SAMPLE 01= GRADE 4 STUDENTS. 

THE TEST PROVIDES INFORMATION IN FIVE MAIN AREAS: DANIE L'S VOCABULARY SCORE IS NEAR 
AVERAGE. IN THE AREA OF LANGUAGE SKILLS HIS SCORE IS QUITE STRONG, AND HIS SCORE IN WORK- 
STUDY SKILLS IS VERY STRONG. HIS ARITHMETICSCORE IS E XCEPTIONAL. 

THE TFST LOOKED AT FOUR SPECIFIC LANGUAGE SKILLS, AND THIS STUDENT WAS RATCO-AS 
FOLLOWS: OUITE STRONG IN SPELLING AND QUITE STRONG IN CAPITALIZATION. RATHER WEAK IN 
PUNCTUATION AND NEAR AVERAGE IN WORD USAGE. 

IN THE AREA OF WORK^TUOY SKILLS. THREE SPECIFIC SMLLS WERE TESTED. IN MAP READING. 
OANIELSEEMS TO BE QUiTE STRONG WHIL€ HE IS NEAR AVERAGE IN READING GRAPHS AND TABLES. IN 
HfS KNOWLEDGE AND USE OF REFERENCE MATERlACSHE IS QUITE STRONG. 

IN THE AREA OF ARlTKME TIC, HE APPEARS TO 8E NEAR AVERAGE IN CONCEPTS AND VERY STRONG 
IN PROBLEM SOLVING WHILE HE TENDS TO BE EXCEPTIONAL IN THE MODERN MATHEMATICS SUPPLEMENTARY 



DIAGNOSTIC KEYS INDICATE THAT DANIEL IS PROFICIENT IN: 

SOLVING PROBLEMS INVOLVING MONEY 

SUBTRACTION. 

AODIT^ON. 

UNOERSTANOINQ THE CONCEPT OF WHOLE NUMBER (N MODERN MATH. 

DIAGNOSTICS ALSO INDICATE THAT DANIEL IS DEFICIENT IN: 

SPELLING BECAUSE OF PROBLEMS IN VOWEL SUBSTITUTION. 
USING THE COMMA. 

PUNCTUATION BECAUSE OF OVERPUNCTUATION 

STUDENT PERF0»4MANCE IS EVALUATED IN SEVERAL WAYS. BY THE TE ACHE R. BY THE PARENTSOF 
THE STUDENT AND. OF COURSE, BY THE STUDENT HIMSELF TEST RESULTS 00 NOT REPLACG ANY OF THESE 
BUT Can be valuable in that they are another SOURCE OF DATA THIS T£ST, LIKE ANY TEST 



COMMCNTS ABOUT DANIEL MARSHALL FROM MRS. ANASTASi 



Narrative testing reports were generated for a random half of fifty-two 
fourth-grade classes in seventeen schools. Three major conclusions were 
reached as a result of the valuation of the narrative reports when compared 
to the traditional reports: (1) The teachers preferred receivinp the 
narrative reports to the traditional reports; (2) the teachers who received 
the narrative reports felt better prepared to communicate inforf^ation 
obtained from the tests to the parents of their pupils than did teachers 
who received the traditional reports; (3) receipt of the narrative reports 
had a greater impact on the teacher's perceptions of pupil performance that 
did receipt of the traditional reports. 

The Madison Project did a respectable job at what it did, but it 
did not do enough. It took a major step in humanizing testing reports 
and in offering an alternative to the obstacle of terminology and numerical 
ratings, but it only reported the pupil's performance compared to other 
fourth gradev^s no reference was made to the child's performance compared 
to his own previous performance. The Madison reports generated the same 
basic format for all children, making no allowances for different needs at 
different levels of performance. The greatest shortcoming of these 
reports, however, was the absence of a pupil report. 

The Iowa Project 

A project conducted during the summer of 1972 under the auspices of 
the Iowa Testing Programs developed a model for a narrative reporting 
system for the fifth-grade level Iowa Tests of Basic Skills. The model 
built upon the Madison Project, but the emphasis was on the basic 
conceptualization rather than on developing the technology for implementing 
the model . 

The most important changes from the Madison Project to the Iowa 
Project were: (1) the addition of a pupil report; (2) the inclusion of 
growth statements; and (3) the use of three alternative levels of the 
parent and pupil reports -- levels that are based on overall pupil 
performance on the test battery. An example of the kind of pupil report 
we developed as Figure 5. 

The growth statements are verbal in nature and are based on the difference 
between th<t score obtained by the pupil on the current year's testing and 
the score obtained at some previous administration, usually one year 
earlier. The three alternative levels of the parent and pupil report 
approach their audiences from different bases: a low performing pupil 
is given encouragement after showing growth, even though his performance 
level is low, while a high-performing pupil may be given specific suggestions 
on how to improve in an area in which his performance is high, if It^is 
his weakest area. 

Other changes also were designed: the parent report was expanded to 
include a general explanation of tests and test results; suggestions for 
increasing performance were included in the parent and pupil reports; 
comments to reinforce growth were added; the reading leveV of the reports 
was lov/ered; the teacher report was shrunk to a skeletal report. 



Figure S 

Best copy available 

PUriL REPORT ON PFUFORfUNCE ON TIIE IOWA TCSTS OF BASIC SKILLS 

Adoiinlstered January 1975 
Iowa City Public Schools 

lown City, lo\<^ 
liURACI; !1ANf! SCjIOOL 

Pupil: JOfIN MACK fjRA[?F 6 Teacher: Mns, n fOlARr^, 

A few wcuV:, i^c, y,»u io i the lowi Tests of Basic Skills, You may remenber that 
it hud questions on vocabulary, spelling, capitalitation, punctuatioo,^nd readlnij 
MHps, s^Ji'b^, iikI talks. riu?re vere als^ quertions about ^hort rtorics yoii were 

Tlkoso tests iUvn yi^vj fi chance tn find out hrw yon are inipp in the skills that 
arc liSCM ir icliool . Vc .r uic^cr r.-^v.: the ttsts to cvor>'one in tJio to hc1|> 

nor see whrrt areas tho class ijee<ls most work. Another reason for jrlvinii thr 
tests was to ^^ivc you 1 afotiiJation on your skills* which skills are strong, and 
wM/h ones are weak. It's cood to find out whlcH skill*; reeH attention. ^Jnce 
then yon can work to improve then). 

This report is to let vou know Vow Vim dM ti\ the tests The first con^nent for 
each teU tells you hov^ strong or weak yotir score was in that area, compared to the 
scores of other students in sixth cr.^de in Iowa. Your scores is also comnared to 
tni: score you had on a similar test vou took in rhe fifth ^'rade. This shows how 
mucn you k,rown in that area since last year. 

vDLMiiJLAkY In the test on vocabulary, your score was near avera<»e. tour 

{growth 'Jurlnti* thr» «^^«!t vf^^v yi* ii<>l'>t' ^^^f^y^'^p One ^oo^ to 
irnprove your vocabulary would he to t-^^p n I'trle tl'^e to lonV in 
the dictionarv for tne meanlnt? of words you arc not sure ot , it 
takes extra iIdc. md sometimes vni.i miRht have to look up the 
sane word several ti^es before you renemher its iroanin?. hut 
your vocabulary will t^et bl^per nwo you will better iir'if>r«rTr • what 
you road and i\ear . ^nd vou will he better able to express what 
you thinK 



lour oertormance on triis tef^t showed strength. You sbow<M 
nornal p,rowth in rea-Mn*^ in the ^ear In this t^«t vo>i dlrj 

verv well jn ^pei"'^ "nd Mrijersf^t^fM v'^r^ort'^rt f^e*<; fln*' H''t ii is 
in v.hr*t v">M T » t'^u '*'ms* n^e t^ reaH h'*'*in<^e do It ^o ^/ell 



SKILLS 



%PrhMW 



'!\ *fc 'vi? t » * tn•^' »-i^ur'>' *^»'» "^^r'fi^nic*^ writvp, your 

''M J 1 1 oy* ra\^r '» /'>rii;r ''nii^ ^^rOKlh t'ro'J^ •'ear 

^as i tlow rtveraf!;C, and these are some areas where a little extra 
i%ork would pay off. 

Your score on this test was very v-^r^V . You shoi'f*f1 •^Ittl'^M'^ 
growtli since last year. Looking a llttU- closer a^ sc^^e of t^^ 
questions you iitissed on this test. It ftpren*»<t fh\t va«j « •I'^ctlr'^es 
arc not snvt which vowels correctly spell a word. If you really 
want to Ijiiprovo vour spelHnp, you can. Use a dictionary to 
check spellings Your teacher will Rive you help too, If you 
want 1 1 . - 



CAPITALIZATION Your perfornan^e In cani tall nation was near average. You 
showed no nh a I gvovtv Vo. di: . viy well in capi tallzing 
Q tieoiraph? c ter.u^. U<;lng proper c^pitaMaation in letter wrltln^t 

ERIC la an area in which you could use some work. 
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BKT COpY available 



PUNCTUATION 



USAGE 



i;OKK-STUDY 
SKILLS 



Your performance In this area of language skills was 
less than average. Your growth was below average. You 
tended to use too much punctuation, and you my want to watch 
that, The use of punctuntioti In writing letters was notices 
ns an .-^roa In which you made several mistakes, Mrs. Richardson 
can help you in these areas if you would like, 

Your performance in the proper use of words was near averaf^e. 
Your growth since last year was nortiial. In this test you did very 
well in usini^ verbs, 

Thrro wore three tests that measure work-study skills; a 
map readin^i test, a test of readin.:^ graphs and tables, and a test 
of your knowledge and use of reference materials. In general, 
your performance was near average. You shov^ed normal growth. 

^lAP kKA01NG--Your score on this test was near average. Your 
growth since last year was below average- Yon secmod to have 
trouble locating places on t.iaps ajid j;lobos, 5>omo practice in 
using a ;.pp of lown City and the state of Iowa would be helpful. 
(The attendant a^ a ^as station mlQbt ^Ive you a map if you 
asked for it,) 

READING Gf<APfiS AND TAfJLFf^^-You have shown strength in this ^^kill, 
Your growth in this area is above average, You've lmprove<l in 
this area and skouM jc proii.) or it. 

RCFKrttNCE NiATliiUALS^-Yotir knowledge uikJ use of reference materials 
is near average, accordinp, to the test. You've shown normal jjrowth 
since la^t year. You did miss itucstlons on the use of an index, 
You mi^ht want to practice uslnp the index that yon find At the 
back of many books • 



MATllu 'iATlCi> 
SKILL:» 



Vuur overall pcfl'ojMuiiicc i;: the tuo tc^ts nt irithroctic s^cills 
shows you to have strength in this area. Your prowth in these skills 
since last year was abuvo nvcm^i , l:\ pf^ncrrjl, you are J jin^:, very 
v.cH in r;ath. Kct;p it upl 



MATHEMATICS CONCEPTS- Your Score on this test Showed strenjith. 



You 



\ALiL:;A7I{:f: pr.:;!;!.!:' '-/^LVLVJ-Vul have sUowt. strong '^>erfor^;)nnce in 
this area. Your growth In this skill was above averap,e. You did 
partlcurlarly well in solvin$; proble^ns Involvint! :i'>ney. Y^^u did 
well in solving addition problwns. 

In general > these tests show tht^t you have done very well in inprovhi;^ your 
natbenatics skills in thl?; past year, but not so well in vooaruilnr- unJ Inniuage 
skills. You will want to pay close attention to spellinp and punctuation. You 
also showed >;ood progress in reading graphs and tables. 

There are other things you do at school that are also important, You are 
growing in many ways, not only in your sMlls, but also as a person. The Iowa 
Tests of basic Skills do rot mor»<:nre t^^e^r r^t^u^r areas of growth, so they have 
not been talked about here. It's important that you , your patents, and yeur 
teacher talk about these other areas-*your everyday activities in all areas 6f 
school, your interests, and how you feel about schooK That was, all df you can 
bo more $ure that you are getting the most out of your experience in school. 



Some Potential Advantages 

Depending upon the specific application, several advantages accrue 
from the use of narrative reports. A few general advantages follow: 

*CJear Cornmunication - The report is in understandable English and does 
not ask the recipient to search the page for clues on where to begin 
reading" the report. 

♦Personal - The use of the testee's name and the appropriate personal 
pronouns can easily be included in the text to huma^L the report and 
lllZtl'' P^^^ It does not "look like a compute? 

♦Efficient " A more complete report is available at the cost of fewer 
professional-person-hours. Narrative reports are not suggesteri as a 
substitute for the professional, but rather as an aide to the professional 



wl^i'^S^f be reasonably self-contained with 

less need for individual guidance to assist in Its initial interpreta 



tation. 



rc^n^lwIS 7 The underlying philosophy of the narrative can be varied 
as needed for different audiences and audience sub-sets. 

♦Public Relations - An inherent public relations value can accrue 

to the organization from a professional report that is understandsi^l^- ' 

and personal 1 zed. 

Certainly there are opposing arguments. that could be offered: 

♦Muddled Communication - The report has to be read, thereby restricting 
Its audience. Realizing that, the reading level of the report still makes 
communication less than efficient with another segment of people. Others 
who can read wel 1 , do not want to be bothered to read -- they just 
want the score, and without extraneous verbiage. 

♦Too Personal Some people. may react negatively to the thought of a 
machine attempting to be "intimate" with them. ■ uyni, qt a 

♦Expensive -initial development of the system is expensive with no 
promise of a lowered cost per report. 

, . ^^^f ^l^t could also be extended, and perhaps you will add to it 
during the discussion. We do not pretend to propose a panacea for 
reportlng-problems. It does appear, however, that narrative reports 
have a place, and that their application should be further explored to 
determine its precise location. 
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